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Entropic measures of complexity are able to quantify the information encoded in complex network 
structures. Several entropic measures have been proposed in this respect. Here we study the 
relation between the Shannon entropy and the Von Neumann entropy of networks with a given 
expected degree sequence. We find in different examples of network topologies that when the 
degree distribution contains some heterogeneity, an intriguing correlation emerges between the two 
entropies. This result seems to suggest that this kind of heterogeneity is implying an equivalence 
between a quantum and a classical description of networks, which respectively correspond to the 
Von Neumann and the Shannon entropy. 
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I. INTRODUCTION 

Measures of complexity are central to the investigation 
of complex networks [lHj] in social, technological and bi- 
ological contexts. These measures allow us to capture dif- 
ferences and similarities between networks appearing in 
vastly different contexts, which furthers our understand- 
ing of the information encoded in complex networks. In 
particular, following [lj-Q one may define the complexity 
of a network as a summary of the underlying graph struc- 
ture. Consequently, the presence of hierarchical organi- 
zation Q or a scaling behavior of the degree distribution 
[l[ are examples of structural features that contribute to 
the complexity. 

Recently, following information theoretical and statis- 
tical mechanics paradigms, several entropic measures for 
complexity [6l42l| have been proposed for network struc- 
ture. These measures have been shown to be extremely 
successful in quantifying the level of organization en- 
coded in structural features of networks 0, l22l - |25| . 

Nevertheless, the relationship between the different en- 
tropic measures remains an open question. In a previous 
paper 15 1, we found insightful connections between the 
Von Neumann and the Shannon entropy. The Shannon 
entropy S of a network ensemble is proportional to the 
logarithm of a typical network in the ensemble. As such, 
the Shannon entropy of all networks with given struc- 
tural constraints has the clear interpretation of quantify- 
ing the information present in network structures. The 
smaller is the entropy of an ensemble, the stronger are 
the limitations imposed by the constraints and, in some 
sense, the more optimized is the network. It turns out 
that the Shannon entropy of an ensemble depends on the 
number of constraints that are imposed. In particular, 
more constraints imply a smaller entropy Additionally, 
the entropy also qualitatively depends on the type of con- 
straints. For example, the entropy of scale-free networks 
fiol fllj is much smaller than the entropy of networks 
with exponential degree distribution also if in both cases 



only the degree distribution of the network is fixed. This 
result is able, for example, to quantify how much more in- 
formation is encoded in such scale-free networks respect 
to networks with other degree distributions. 

The von Neumann entropy of a network, Svn, was pre- 
viously introduced by Braunstein, Ghosh, and Severini 
@, Q and later discussed in [l2[ and [TtJ ■ This quantity 
is determined by the spectrum of the graph Laplacian C 
of the network. Specifically, considering networks with 
N nodes and an average degree of (k), we have that 
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where Tr£ = (k)N. The authors of [12| demonstrate 
that the von Neumann entropy may be seen as a mea- 
sure of regularity in networks, i.e., regular graphs with an 
equal number of neighbors for all nodes tend to display 
a higher entropy than those with heterogeneous degree 
distributions and the same number of links. Since C has 
eigenvalues \ , for i = 1 , . . . , N and at least one eigen- 
value is equal to zero, the maximum of the Von Neumann 
entropy is reached when all other eigenvalues are equal 
and hence Svn < log (AT — 1). This bound is also satu- 
rated by random graphs in the asymptotic limit jTsj . 

In the present paper we explore in greater detail the re- 
lation between the Shannon and von Neumann entropies, 
S and Svn, respectively for an ensemble of networks with 
hidden variables that fix the degree sequence. Our results 
indicate that for the canonical ensemble of exponential 
random network, in the limit of large iV, the entropy 
Svn — 0[\og(N)]. This rule holds irrespective of the 
scaling of the average degree (k), and the degree distri- 
bution which arc responsible for the sub-leading correc- 
tions. Moreover, as soon as we introduce heterogeneity 
in the expected degree of individual nodes, the von Neu- 
mann entropy correlates with the Shannon entropy in 
a non-trival manner. The heterogeneity of expected de- 
grees induces an intriguing relation between the quantum 
description of the network captured by the Von Neumann 
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entropy and the classical description of the networks. It 
has been already shown that growing complex networks 
with heterogeneous feature of the nodes show in their 
evolution some sort of quantum effects }28l - l3lj ]. in the 
sense that the evolution of these networks is described 
well by quantum statistics. 

Here we observe that the simple heterogeneity in the 
degrees induces a correlation between essentially classical 
and quantum measures of complexity of the networks. It 
may be valuable to interpret this fact with particular at- 
tention to the classical-quantum interface. The sugges- 
tion arising from our discussion tells in some way that 
mixed quantum systems, consisting of ensembles com- 
posed by many pure states, have a more classical nature 
when their von Neumann entropy correlates to the Shan- 
non entropy. In our case, this is exactly when there is 
some "extra amount of disorder" introduced at the de- 
gree level. The hypothesis opens a scenario to further 
investigate this kind of correlation, with the purpose to 
study properties of the transition from quantum to clas- 
sical physics, at least when considering large ensembles 
of two-level states. 

The paper is structured as follows. In Sec. II, we 
define and evaluate the Shannon entropy for networks 
ensemble with expected average degree sequence. In Sec. 
Ill, we define the Von Neumann entropy of networks in 
terms of the Laplacian spectra. In Sec. IV, we we show 
how the Laplacian spectra can be calulated by the cavity 
methods. In Sec. V, we compute the Lapalcian spec- 
tra of dense networks. In Sec. VI, we use the Effective 
Medium Approximation for the spectra or sparse net- 
works. Finally, in Sec. VII we show that the Shannon 
entropy and the Von Neumann entropy of networks with 
heterogeneous degree distribution correlate in the cases 
of dense and sparse network ensembles. Conclusions are 
drawn in Sec. VIII. 



II. SHANNON ENTROPY OF CANONICAL 
ENSEMBLE WITH HETEROGENEOUS DEGREE 
DISTRIBUTION 

In general, the entropy is defined as the logarithm of 
the number of networks in the ensemble. One distin- 
guishes between two types of ensembles; (i) the micro- 
canonical ensemble, where structural features - con- 
straints - are satisfied by all networks in the ensemble. 
The G(N, M) model [H, [33| from the theory of random 
graphs is a simple example of a micro-canonical ensem- 
ble of networks with N nodes, where we dictate that the 
total number of links is M. The entropy for the micro- 
canonical ensemble may also be computed via combina- 
torial methods, (ii) One also defines canonical ensembles, 
where constraints are satisfied on average. The comple- 
ment of the G(N,M) ensemble is the G(N,p) model, 
which corresponds to the canonical ensemble of networks 
with N nodes and a fixed probability p for a link to be 
present. The total number of links M in the G(N,p) en- 



semble is Poisson distributed with average (M) = pN. 

The parallel between microcanonical and canonical 
network ensembles can be extended to include more gen- 
eral communit y, s tructural and even spatial constraints 

In this paper, we focus on the canonical ensemble with 
fixed expected degree sequence, which is the conjugated 
canonical ensemble of the configuration model where the 
degree sequence is fixed. This ensembles is also known as 
the hidden variable ensembles and thse have been studied 
both by statisticians and physicists [1(1 EH 

A network belonging to the canonical ensemble of un- 
correlated network with fixed expected degree sequence 
may be constructed as follows: 

• For each node i, draw its expected degree qi from 
the probability distribution p q , where g; < \J {q)N 
and (q) = , p q > q' '. The upper bound condition 
for the qi ensures that they remain uncorrelated 
across nodes. 

• Between nodes i and j we add a link with proba- 
bility 



Pij 



qiq 3 

(q)N 



(2) 



In the large network limit N — > oo the degree ki of each 
node i in this ensemble is given by a Poisson variable 
with mean and variance equal to qi. Therefore also the 
total number of links is a Poisson variable with average 
(k) — > (q). It follows that the average degree of each 
network realization is a self-averaging quantity for net- 
works in which < q >= o(N), i.e. the expected degree 
converges in probability to a delta distribution peaked at 
the expected average degree ((fc) = (q)). 

The entropy of canonical network ensembles is readily 
obtained from an appropriate definition of the ensemble 
flH 13414371 ]. Each network is defined by its' adjacency 
matrix A <G {0,l} NxN , where ay = aji describes the 
presence (ay = I) or absence (ay = 0) of a link between 
nodes i and j. Each network of the canonical ensemble is 
assigned a given probability distribution V({a}) defined 
over its adjacency matrix {a}. This is 



nw)=n^ ii ( 1 -^) 1 



(3) 



describing the fact that a link between nodes i and j 
is present (ay = I) with probability py and is absent 
(ay = 0) with probability (1— py). The Shannon entropy 
of such an ensemble is defined as 

M 

= ill ■ logPtf + (1 - Pij) log(l - Pa)] j(4) 
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Substituting the form ([2]) of the link probability in 
the canonical ensemble with expected average degrees, 
we get 



S = 



(q) 



log (q)N-^Yl^ hl 



q t q 3 



For convenience, we introduce here the quantity 

S p = J dqp q q\n(q) . (6) 

This gives us that 

S = (q)log(q)N-S p + 

~ jdqdq' Vq p ql (l - log (l - 

If we expand the last term in the right hand side, we get 
the approximate relation 

S ~ (q)\0g(q)N + S p -(q) 

~Jj2 jdqdq'p qPq , . (7) 



III. VON NEUMANN ENTROPY 

In quantum mechanics, a mixed state is a statistical 
mixture of pure states. These are represented by rays 
in Hilbert space and correspond to the maximum knowl- 
edge which can be acquired about the system. Mathe- 
matically, each quantum state is described by a density 
matrix, i.e. a positive semidefinite, trace-one, symmet- 
ric matrix. The density matrix of a system with Hilbert 
space %n 



N 



(8) 



! = 1 



where u>i is a real weight from a probability distribution 
and \ipi}(4>i\ is the projector corresponding to the pure 
state \ipi). In words, each density matrix represents a 
convex combination of pure states, which are then the 
extremal points of the set. 

The amount of "mixedness" of a quantum state is given 
by the von Neumann entropy, which, in this sense, can 
be seen as the quantum analogue of the Shannon entropy 
[27j | . In information-theoretic terms, the von Neumann 
entropy quantifies the incompressible information con- 
tent of a quantum source, where the signal is given by 
pure states; the entropy of a pure state is zero. Ad- 
ditionally, it has an important operational meaning, be- 
ing the unique measure of bipartite entanglement in pure 
states, via the notion of a reduced density operator. The 



connection between quantum mechanics and thermody- 
namics is expressed by the fact that S (p) is invariant 
under Schrodinger evolution, for systems completely iso- 
lated from the environment. Indeed, entropy increases 
with measurement processes, but 



S(p) = S(U P U f ) 



(9) 



for any unitary operator U. 

The definition of S suggests a direct way to associate a 
quantum state to a network, by making use of the graph 
Laplacian. Importantly, the invariance under unitary op- 
erators guarantees invariance under graph isomorphism. 
A discrete analogue of the Laplace-Beltrami operator, 
the graph Laplacian is a positive semidefinite symmet- 
ric matrix. Once normalized in appropriate way, it can 
be treated density matrix. Let G = (V, E) be a 
simple undirected graph on N nodes and L links with 
adjacency matrix {a}. From this adjacency matrix we 
construct the graph Laplacian C where 



(10) 



whore h; 



- 2^=1 



The Laplacian operator appears 



quite frequently in the study of diffusion [38[ , resonance 
in electric circuits [39j . and certainly in a myriad of ap- 
plications in combinatorics and computer science [261 ] . 
We associate to each node of the network a state in 
the standard basis of an Hilbert space of dimension n: 
1 <-> 1 1), iV <-> \N). Each link {i,j} corresponds to a 
pure state — \ j)) The associated density matrix 
is 



= ^(\i)(i\ + \j)U\-\i)U\-\j)(i\) 



(11) 



The density matrix of the pure state (|z) — \ j)) /v 2 corre- 
sponds to the Laplacian of a graph with a single link and 
with N — 2 nodes of degree zero, being N the dimension 
of the space. The density matrix pujx is a pure state. 
Taking equal weights uji.j depending on the number of 
edges, the matrix 



(k)N 



1 



.3} 



(k)N 



C 



(12) 



is just the Laplacian of the graph, but adjusted to have 
unit trace. In this expression, the weights may be chosen 
arbitrarily, with the only constraint Ylu j}eE ^i-j = 1- 

Since the smallest eigenvalue of the Laplacian is zero, 
we expect that Svn € [0,log(A — 1)]. The maximum 
Svn is attained by the complete graph on N nodes, 
and in the thermodynamic limit by any Poisson random 
graph (l8j . The minimum is clearly for pure states. 

The Von Neumann entropy on suitable rotation of the 
Laplacian matrix about its eigenvector basis can be ex- 
pressed as 



S VN = ln(iV) - J d\m(X) A In f-^j 



(13) 
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where the term m(A) denotes the density of eigenvalue 
state A of the Laplacian. Therefore the Von Neumann 
entropy has a leading term of order log(iV) and a sub- 
leading terms determined by the spectrum of the Lapla- 
cian. Apart from issues arising from cospectrality, where 
nonisomorphic graph can have the same entropy, it is 
also worth observing that the expansion properties of the 
graph do not seem to be responsible for the behaviour of 
the entropy, since the fact that the eigenvalue gap "com- 
presses" the eigenvalues towards zero does not have other 
direct implications. In fact we observe that the second 
term on the right hand side of Eq. ([Tl?]) is dominated by 
the behavior of the density of states m(A) for large values 
of the eigenvalues A's. Therefore, the large eigenvalues 
of the graph Laplacian, that determine the fast temporal 
scales of the diffusion dynamics on the network, gives the 
largest contribution to the Von Neumann entropy 

The Von Neumann entropy is defined on every single 
graph. Nevertheless, it is instructing to evaluate the Von 
Neumann entropy of ensembles of graphs with different 
degree distribution. This helps to understand the impact 
of the heterogeneity of the network on this new quantity 
relating networks to quantum states. In canonical net- 
work ensembles the Laplacian spectra is self-averaging as 
long as (k) = l(N), meaning that the spectra of a net- 
work of this ensemble will approach the average spectra 
of the network in the ensemble in the large N limit. We 
note also that since in the canonical ensemble the average 
degree (k) is a self-averaging quantity, the Von Neumann 
entropy of large networks in the canonical network en- 
sembles can be written also as 



Svn = ln(A0 



dAm(A) T-r- In f —- 

w V (<?) 



(14) 



bles is self-averaging. Thus, the density of eigenvalues A 
is given by 



1 N 

m(A) = lim -^<5(A - X. t ) A . 

N — ► oo IS L — ' 



(15) 



where {Ai} is the sef of the eigenvalues of C and the 

over-line (...) denotes the average over the probability 
V({a}). This is given by Eq. ([3]), for networks in the 
canonical ensemble. To calculate this object in the large 
N — > oo limit, one introduces (40l | the partition function 



N 
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N 



Z(X) = / n d & ex P (- ^ E # + \ E & £ « *i) ' 

i— 1 i—1 i}j = 1 

. (16) 

where A e = A + i e. The introduction of a small imagi- 
nary e is to ensure the integrals are convergent and well 
defined. In terms of Z, we have 



m(A) = lim -— — Im — log Z(X) . (17) 



To facilitate the averaging over the canonical ensemble, 
one uses the replica trick and writes 



IV. LAPLACIAN SPECTRA OF COMPLEX 
NETWORKS 



logZ(A) = lim -log W , (18) 

n-tOn 



As mentioned in the previous section, the Laplacian 
spectrum of a network in the canonical network ensem- 
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(19) 



This result is independent of scaling assumptions on (q) . 
In what follows, we consider the cases where (q) scales 
with N, i.e., a dense network, and where (q) ~ 
separately. 

V. DENSE NETWORKS 



further simplify Eq. (|19|) . by expanding the inner expo- 
nential, and obtain 



For dense network ensembles with divergent average 
degree, i.e., when (q) oo as N — > oo , it is possible to 



5 



-A 



n N / . n N N n 



a=l i=l 



a=l i=l 



r 



i,j = l a = l 



via) 



(20) 



where x% = qi/(q). We now consider two further sub- 
cases for the distribution p q of the qi expected degrees. 

• Poisson networks. In this case, qi = (q) and hence 
Xi = 1. Following [38|. the Laplacian matrix CI (a) 
has one eigenvalue equal to unity and the remaining 
N — 1 eigenvalues equal to zero, i.e., 



IOOOf 



to(A) 



1 



A r 



1 



N 3 M ■ N 
Putting this result into Eq. (fT4")) we obtain that 

S VN =]n(N) +o(l). (22) 

• Exponential networks. For uncorrelated exponen- 
tial network ensembles, the probability that a ran- 
domly selected node i has expected degree qi = q 
is given by 



>[A,0] 



(21) 



— e-«/<«) 



(23) 



Denoting a;j = q%/{q), the probability that node 
i has an associated expected degree x is given by 
ir(x) = e~ x . The eigenvalues A are given by A = Xi 
with degeneracy N ir(xi) — 1 if N 7r(xj) > 2, while 
the remaining A" eigenvalues are equal to zero. For 
a dense exponential network of size N, the value 
of K is given by K = IniV — In 2. Therefore, the 
density of states is equal to 



m(A) 



tt(A) - — 



K 

N 



>[A,0] 



(24) 



It follows that, in the limit of large AT, the spectrum 
m(A) is formed by a peak for A = and a bulk 
spectral density that is decaying exponentially with 
a behavior reminiscent of the degree distribution. 
So, the Von Neumann entropy is 

S VN = ln(N) - / dxe~ x x \n{x) +o(l), 
Jo 

(25) 

In Fig. [TJ we represent the spectrum of large dense net- 
works with exponential degree distribution showing the 
exponentially decaying density of states. Therefore the 
Von Neumann entropy of the exponential dense random 
ensembles has a term \og(N) and a subleading term equal 
to the entropy of the degree distribution S p given by Eq. 



Svn = ln(N)-S p 



(26) 
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FIG. 1: (Color online) Laplacian spectra of dense networks 
with exponential expected degree distribution. The data 
are obtained from networks of size N = 1000; the number 
of links and p q are distributed exponentially with average 
(q) = 50, 60, 70, 80, 90. The data are averaged over 20 net- 
work realization. 



VI. SPARSE NETWORK ENSEMBLES 

For sparse network ensembles, where (q) ~ 0(1), the 
analysis of the previous section does not hold. In par- 
ticular, we cannot expand the inner exponential in Eq. 
(fT9| in terms of large (q). Predicting Laplacian spec- 
tra of sparse graphs is a problem that up to date has 
been only solved numerically, by the use of population 
dynamics techniques or message passing techniques. In 
this paper, in order to determine the behavior of the tail 
of the Laplacian spectrum we make use of the Effective 
Medium Approximation j4l| . which gives a fairly good 
approximation of the bulk properties of the spectrum. 
In Appendix [A] we also show how to derive the Effec- 
tive Medium Approximation from the exact calculations 
of the spectrum by population dynamics. 

Assuming that the expected degree q can assume any 
real values drawn from a p q distribution, the density of 
states tos(A) in the Effective Medium Approximation is 
given by 



me (A) = - J dq p q Im 



1 



A £ + qflEMAW ' 



(27) 



with the variable Hema satisfying the self consistent 
equation 
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(28) 



6 



A. Sparse Poisson random networks 

For the case of the G(N,p) ensemble the spectra is 
given by 



m E (X) = -Im- — — !- , 

7r A e + qriEMA 



with q = pN, and 

h-EMA 



1 



A e — 1 + qhsMA 
The solution to this equation is 

qJiEMA = -[-(q — l + \ e )± 



(29) 



(30) 



iy/4q\ e - (1 + A £ -qf 



(31) 



Plugging this solution into Eq. (|29j) , we see that in order 
to have a positive density in Eq. ([3"Tjl . the effective field 
h em A must be complex with negative imaginary part. It 
follows that in the limit e — > 0, 



me (A) = 



yftqX - (I - A - qf 



ir(q-l-\) 2 + (q-l + \) 2 -4\q' 



(32) 



We can see that the spectrum of the Laplacian is not 
expected to show clear correlation with the degree dis- 
tribution of Poisson networks. As a consequence of this, 
the Von Neumann entropy of Poisson sparse networks is 
not correlated with the Shannon entropy of the networks 
or the Shannon entropy of their degree distributions. 



Sparse Networks with heterogeneous expected 
degree 



We have numerically solved Eqs. (|27p — (|28p defining 
the spectra of networks with heterogeneous expected de- 
greee in the Effective Medium Approximation. In Fig. 
[2j we report the predicted spectra for space exponential 
networks with degree distribution 



PE{q) 



_L p -9/<9> 
(<7> 



(33) 



and for power-law networks with expected degree distri- 
bution 



Psp(q) = m 1 l)g 7 - 



(34) 



In the case of large eigenvalues, the spectral density 
follows a power-law distribution for scale free networks 
and an exponential distribution for exponential networks. 
The theoretical expectation are confirmed by direct diag- 
onalization of the Laplacian matrices reported in Fig. [3] 
Indeed, it is explicitly shown that the tail of the spectrum 
of the Laplacian has an exponential behavior for networks 
with exponential degree distribution, and a power-law 
tail for networks with a power-law expected degree dis- 
tribution. In Fig. [2J we have numerically integrated the 
Effective Medium equations. 
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FIG. 2: (Color online) Laplacian spectra predicted by the 
Effective Medium Approximation for graphs with power-law 
(Panel (a)) and exponential (Panel (b)) distribution of the 
expected degrees. The predicted spectrum for large eigenval- 
ues A has a power-law behavior for scale- free networks and an 
exponential behavior for exponential networks. 




FIG. 3: (Color online) Spectra of single networks with power- 
law (Panel (a)) and exponential (Panel (b)) expected degree 
distribution. As predicted by the Effective Medium Approx- 
imation, the spectra of the Laplacian matrices of power-law 
networks has a power-law tail, while the spectra of networks 
with expected exponential degree distribution have exponen- 
tial tail. The data in Panel (a) are obtained from single net- 
works of size N — 10 4 ; the data in Panel (b) are obtained 
from 20 network realizations of size N — 10 3 . 



VII. CORRELATION BETWEEN THE 
SHANNON AND THE VON NEUMANN 
ENTROPY IN SPARSE NETWORKS 

The prediction of the Effective Medium Approximation 
indicates that as soon as the heterogeneity of the degree 
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FIG. 4: (Color online) Comparison between the Von Neu- 
mann entropy Svn, the Shannon entropy S, and the entropy 
of the expected degree distribution S p . These are for net- 
works with power-law and exponential degree distribution, as 
a function of the average degree and the value of the power- 
law exponent 7 of the scale-free expected distribution. For 
every value of the Shannon entropy, an average is performed 
over 20 network realizations with exactly the same Shannon 
entropy. 



given expected degree sequence. We report facts occur- 
ing for a variety of networks, including dense and sparse 
networks. We have seen that, when a certain hetero- 
geneity of the expected degree sequence is introduced, 
an intriguing connection appears between Von Neumann 
and Shannon entropy. This connection is missing for net- 
works with homogeneously distributed average degrees. 

More than trying to interpret immediately the ob- 
served connection, it is worth instead to formulate an 
open scenery, with the purpose of directing a future 
line of research. Essentially, it is legitimate to ask 
whether the Shannon and the von Neumann entropy are 
correlated for mixed states exhibiting a certain degree of 
classicality. In this light, it is plausible that the relation 
between these two entropies can shed a new light into 
discussions about the quantum-to-classical transition. 
The specific aspect of this framework does not have the 
potential to address problems associated to decoherence 
of pure states, but the classical characteristics of mix- 
tures with many components. 
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is introduced the Von Neumann entropy is dominated by 
the tail of the Laplacian spectrum. Since this tail has 
in the first approximation the same distribution as the 
expected degree, the Von Neumann entropy is linearly 
correlated with the entropy associated with the expected 
degrees. Moreover, since the Shannon entropy is also re- 
lated to the entropy associated to the expected degrees, 
this relation is reflected in a clear correlation between 
the Shannon and the Von Neumann entropy. In Fig. [3] 
we show that the expected results about the eigenvalues 
of the Laplacian of scale-free and exponential sparse net- 
work are confirmed by the simulation data. The data 
are obtained by comparing the Shannon and the Von 
Neumann entropy, and the entropy associated to a given 
expected (exponential or power-law) degree distribution. 
All the networks have size N = 1000 and the different 
points correspond to network with different average de- 
gree for the exponential case, and network with different 
power-law exponent for power- law networks. 



Appendix A: Derivation of the Effective Medium 
Approximation from the Replica Method 



In sparse network ensemble, it is possible to find a 
solution for a matrix partition function, Eq. (|19|) . by in- 
troducing a functional order-parameter. This approach, 
first introduced in the context of dilute spin-glass systems 
[42I] . has had wide success in a host of different contexts. 
Formally, defining cf> = (</>i, . . . , <f) n ), we introduce 



1 N n I" 



(Al) 



Following standard arguments, we obtain the following 
functional saddle-point expression for the partition func- 
tion 



VIII. CONCLUSIONS 

We have studied the relation between the von Neu- 
mann entropy and the Shannon entropy of networks with 



Z(X) n = / ]JVc q ($)e N ^ c ^ x \ (A2) 
where *({c g }; A) = 5 + Si + S 2 and 
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So 
Si 

S 2 



q>0 



1 q>0 J 



dcj) c q {cj)) cj) ■ <j) , 



W/ g,r>0 



d$d\j}c q {$)c r {ij}) expf-^^ - ip a ) 2 ) - 1 



(A3) 
(A4) 

(A5) 



As before, p q is the probability distribution for the ex- 
pected degrees. From this result together with Eq. (|T7l) . 
we note that the density of eigenvalues is given by the 
variance of the functional c q (4>), i.e., 



m(A) 



lim l — Re Vp, ($ ■ <j>) c 
<?>o 



(A6) 



where the angled brackets refer to the average over the 
saddle-point c q ((f>) measure. This is given by the self- 
consistent equation 



o q {4>) = exp --A e • (j) - q 1 - c(» 



where 



1 f ( i n 

7rX^ r / dfpcrifp) exp I wV]( 

W r>0 J V a=l 



(A7) 
(A8) 



r 



It is not possible to obtain an analytic closed expression 
for the c q measure without making further assumptions. 
The most general ansatz that one can make here, and 
expect to hold, is that the measures are invariant under 
replica symmetry. This amounts to write c q as a super- 
position of Gaussian measures. In particular, we write 
that 



/n 
dh q p(h g ) n < 
o=l 



\ h q<t>a. 



(A9) 



and 



{$) = / dhP(h) J] e" 



(A10) 



Thus, the Gaussian measures are parametrized by the 
complex variances l/h q and 1/h, which are solved for to 
obtain the recursive relationship 



P(h q ) = E 



r>0 



e~ q q k 

k\ 



dh 1 



dh k Y[ [P(h 



5 K, 



(All) 



r 



and 



1. The population dynamics algorithm 



q>0 W J 



)6(h 



hg - 1 



(A12) 



These two equations may be numerically solved, in the 
general case, using a population dynamics algorithm, as 
described in the next appendix. To conclude, the density 
of states is given by 



(A13) 



q>0 



Eqs. (|A11[) and (|A12|) can be solved by a population 
dynamics algorithm to find the distribution P(h). We 
summarize the algorithm as follows: 

algorithm PopDyn({/i gi } of M fields) begin do 



• choose a field h qi relative to a node i of the network. 



draw k from a Poisson distribution with probability 



• select n = fields /i™. relative to nodes j, 



9 



chosen with probability proportional to qj . 

k j 

ha. : = A e -V k. (A14) 

^ h n - 1 

n=l % 1 

• update probability distribution function P(h). 

while (P(h) not converged) 

return 

end 



2. Derivation of the Effective Medium 
Approximation 

Finally, this population dynamic algorithm can be 
approximated by the Effective Medium Approximation 
(EM A) equations. Here we describe the derivation of the 
equations presented in the main text from the popula- 
tion dynamics algorithm. In the EMA, we average Eq. 
(|A14[) over the probability that node i with hidden vari- 
able qi has k links, and also over the hidden variables qj 
of node i's neighbors. Therefore using Eq. ^ and that 



the expected degree of node i is (ki) = qi, we get for the 
average of Eq. (|A14[) , the following expression; 

h g = X e -q-q [ dq' q '. P f . 1 . (A15) 

Therefore, if we define 

h E MA = -fdq^-^ 1, (A16) 

J \D hq — 1 

using Eq. (|A15[) . the self-consistent equation for He ma 
defined by Eq. (|A16[) is given by 

h E MA = -fdq^- — L- 1. (A17) 

J (q) K - 1 + qh E MA 

Finally, inserting in Eq. (|A13[) the Effective Medium Ap- 
proximation for the fields h q , i.e., h q = X e + qh em A the 
density of states tue in the Effective Medium Approxi- 
mation is given by 

m E {\) = - [dq Pq Im 1 — . (A18) 

7T J K+qh E MA{X) 
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